Quantum mutual independence 
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We introduce the concept of mutual independence - correlations shared between distant parties 
which are independent of the environment. This notion is more general than the standard idea of 
a secret key - it is a fully quantum and more general form of privacy. The states which possess 
mutual independence also generalize the so called private states - those that possess private key. 
We then show that the problem of distributed compression of quantum information at distant 
sources can be solved in terms of mutual independence, if free entanglement between the senders 
and the receiver is available. Namely, we obtain a formula for the sum of rates of qubits needed to 
transmit a distributed state between Alice and Bob to a decoder Charlie. We also show that mutual 
independence is bounded from above by the relative entropy modulo a conjecture, saying that if 
after removal of a single qubit the state becomes product, its initial entanglement is bounded by 1. 
We suspect that mutual independence is a highly singular quantity, i.e. that it is positive only on a 
set of measure zero; furthermore, we believe that its presence is seen on the single copy level. This 
appears to be born out in the classical case. 



Mutual independence Definition. In the 

paradigm of quantum key distribution 0, 0] , the goal is 
to share a cryptographic key - perfectly correlated strings 
of bits, which are secure, i.e. are not correlated with any 
third person. Although we obtain a secret key from a 
quantum state, the secret key itself is a classical object. 
It also must be perfectly correlated, which is a very par- 
ticular distribution. States that possess secret key have 
been fully characterized in 0, 0| - they are so called pri- 
vate bits (pbits). 

Here we consider a more general paradigm, and one 
which is fully quantum. Alice and Bob are interested in 
obtaining a state which is secure, in that it is not cor- 
related with any third person, but the correlations con- 
tained in the state need not be perfect, nor the state 
necessarily classical. We quantify the correlations by the 
mutual information. Such secure correlations we shall 
call mutual independence. It can be understood as quan- 
tum privacy. 

A protocol for extracting mutual independence, we 
shall call any sequence of local operations A^ 1 ' and A^ 
such that the state 

(«) 

P ABR 



b, such that state p a /3R is product with respect to the 
cut a/3 : R. Now the mutual independence will be the 
maximal amount of mutual information between a and (3 
per copy of the initial state. The choice of this correlation 
measure may appear arbitrary here - and at this point 
any functional monotonic under local operations would 
be eligible. However, the mutual information will find 
its motivation in the section on distributed compression 
below. 

Definition 1 Given state pab, consider a protocol of ex- 
tracting mutual independence V = A„. Define the rate 

1 1 



R(V, pab) = liminf ~/((A^ K 



A ( D n) ) P ^y (3) 

Then mutual independence of state pab is defined as 



lindiPAB) = Sup i? (P, PAS)- 
V 
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For technical reasons we will only consider protocols such 
that there exists a constant c which (ratewise) bounds the 
output dimensions of A^ and A^; \a\, \j3\ < c n . Note 
that this implies similarly \a\ < c n \A\ n and \b\ < c 1l \B\ n , 
so that we can choose a constant r with 



is asymptotically product in the cut AB : R, where ipABR 
is the purification of pab, he. 
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for 



oo, and ||£||i = Tr|£| being the trace norm. 



Using the Stinespring dilations of A^ and A^ , we can 
say it in different words. Namely, a protocol extracting 
common mutual independence amounts to decomposing 
the local systems into two subsystems a and a and (3 and 



Remark. In a similar way one defines LOCC mutual in- 
dependence ij^ d , and one-way distillable mutual indepen- 
dence ij^j, where instead of local operations A^ g) A^ , 
more general A^ implementable by LOCC and one-way 
LOCC, respectively. Let us also mention, that in [H], 
another scenario involving decoupling a subsystem from 
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reference was considered: there only one system (e.g. B) 
was available, and the task was to split it into two parts. 

Given these definitions, it would be good to know, 
which states already have mutual independence. 

Definition 2 We say that the state paba'B' has mutual 
independence in AB if two conditions are satisfied: 

1. The state Prab is product with respect to the cut 
R : AB, where prab = T^A'B'ipRABA'B' , and tp is 
a purification of paba> b> ■ 

2. The state pab is correlated. 

According to the definition of mutual independence in 
eq. (|4]), such states have therefore at least hl(A : B) bits 
of mutual independence. Note the factor of 1/2, which 
we introduce for the sake of normalisation: in this way, 
an ebit has one unit of mutual independence. 

Multipartite case. For more than two parties, we define 
mutual independence in an analogous way. To quan- 
tify it, we employ the following multipartite general- 
ization of mutual information (sometimes called multi- 
information) : 

I(A 1 :...:A N ) = S{A X ) + ... + S(A N ) - S(A 1 . . . A N ). 

(6) 

We shall, however, mostly formulate our results for the 
bipartite case, and only occasionally hint at the TV-party 
generalization. 

States which posses mutual independence are a gener- 
alisation of pbits and for two parties can be characterised 
by 

Proposition 3 A state paba'B' has mutual indepen- 
dence in systems AB, if and only if there exists an isom- 
etry U : A'B 1 CD such that 

{Iab®U A 'B')PABA'B'{^AB®U A 'B')^ =i , ABC®PD, (7) 

with a pure state ip on ABC. 

The proof of this, along with a discussion on the connec- 
tion between pbits and the current work can be found in 
the Supplementary Materials. 

Now, we want to focus on a few examples of mutual in- 
dependence. As noted above, each ebit contains at least 1 
bit of mutual independence, each pbit has at least 1/2 bit 
of mutual independence. However, sometimes this might 
be an underestimate, as one can continuously interpolate 
between a pbit and an ebit. In both cases, on the other 
hand, mutual independence is seen on the level of a single 
copy of the state, and local collective operations will not 
obviously increase it. 

In the following example we show that mutual inde- 
pendence may require collective actions on many copies. 



Example. The mutual independence of a maximally 
correlated state, 

Pab = ^raij\ii)(jj\, (8) 

ij 

is bounded from below by one-half of the coherent infor- 
mation I(A)B) = S(B) - S{AB) = S{A\R): 

Iind(pAB) > \l{A)B). (9) 

Proof. We will simply show that by local unitaries, Al- 
ice and Bob can extract S{B) — S{AB) amount of pri- 
vate key. To this end, assume that Alice and Bob share 
many copies of the state pab and dephase their systems 
in the computational basis (by copying them onto lo- 
cal ancillas). Then they share many copies of a clas- 
sical distribution with perfect correlations. To obtain 
the key it is therefore enough to apply hashing, which 
does not require communication. The amount of key is 
I (A : B) — I [A : R), which computed on the so called 
ccq-state obtained after dephasing gives S(B) — S(AB) 
(the "ccq" means that Alice and Bob have a classical reg- 
ister, while R has a quantum register). □ 
The example of maximally correlated state suggests a 
wider class of states, which have mutual independence, 
but which require collective actions to distill it; these are 
discussed in the Supplementary Materials. 

Possible discontinuity of mutual independence? 

Note that even though the maximally correlated state 
does not have mutual independence on the single copy 
level, we see some singularity in its structure, namely, it 
can be obtained by acting on a singlet with noise, whose 
errors do not span the full algebra: namely, there are no 
bit-flip errors. In other words, the state comes from a 
channel, with a noiseless (classical) subsystem. E.g. we 
expect, that a Bell mixture of rank 3 or 4, with fidelity 
arbitrary close to one, will have Ij n d = 0, even though 
^ind = 1 for fidelity equal to one. 

Similarly, for the rank-two Bell mixture p = (1— e)<!> + -|- 
£<!>", where the above example gives a lower bound on the 
mutual independence of \ (l — H 2 (e)) : we expect that for 
< e < 1 the mutual independence is ii nc i < 1/2, while 
at e — and 1 it is ii n( j = 1. 

In an attempt at formalizing the above, we formulate 
the following conjecture, which identifies the presence of 
a "noiseless (or rather private) subsystem" in the corre- 
lations of pab ■ 

Conjecture 4 A state pab has Ii n d{pAB) > only if 
there exist operators A, B not proportional to 1, such 
that for all states \ip) in the support of Pab, 

(i/j\A <g> B\i/>) = Trp(A <g> B). (10) 
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If the conjecture were true, it would mean that mutual 
independence is a singular quantity: it could be positive 
only on a set of states of measure zero. We discuss the 
conjecture in more detail in the Supplementary Materi- 
als. There, we also discuss the classical analogue to mu- 
tual independence and distributed compression, and in 
this context discuss the conjectured discontinuity which 
appears in a very simple form. 

Upper bounds. In 0, Theorem X.2] one can find im- 
plicitly a proof of the bound T m d{PAB) < E s(1 (pab), the 
squashed entanglement 0. We explain it in the Supple- 
mentary Materials. 

Here we describe an attempt to upper bound the mu- 
tual independence by the relative entropy of entangle- 
ment (Kg 

E r {p) =min S(p\\a), (11) 

a 

where the minimum is taken over all separable states a, 
and cr) = Trp(logp — log a) is the relative entropy. 
Note that the relative entropy measure can be much 
smaller than squashed entanglement [l(J. This upper- 
bound hinges on the following conjecture: 

Conjecture 5 Consider a tripartite state pxab such 
that pab — Pa®Pb- Then the logarithmic negativity En 
across the XA : B cut does not exceed log|A|. The log- 
arithmic negativity is an entanglement measure 
given by 

E JV (p)=log||p r ||i, (12) 

where T = id <£> T is the partial transpose. 

The conjecture states, in other words, that if the ini- 
tial state is product, then by providing n qubits to one 
of the parties, entanglement can be increased at most 
by n. This should be compared with the locking effect 
[13j: there, by adding one qubit, entanglement may be 
increased by an arbitrary amount. However, in all the 
known examples for En, the initial state is non-product. 

We shall first consider states which have exact mutual 
independence in systems AB. 

Proposition 6 Suppose that state paba'B' has mutual 
independence in systems AB. Then, assuming that Con- 
jecture [H holds, we have 

E?(paa>:BB>) > \l{A : B), (13) 

where E?{p) = lim^ ±E r {p® n ) < E r (p). 

The proof goes via standard arguments using monotonic- 
ity and asymptotic continuity of relative entropy of en- 
tanglement, see e.g. its details can be found in the 
Supplementary Materials. Note that here we have to in- 
voke again the technical dimension condition in eq. ([5]). 



Because relative entropy of entanglement is monotonic 
under local operations (indeed LOCC), the proposition 
implies that E^(pab) > ^(pab) > T mA (p A B)- 

Of course, this means that also E r is an upper bound 
on mutual independence, since E r > E^° . □ 

Distributed compression with free entanglement. 

The task of distributed compression is the following: Al- 
ice and Bob share state p®^ and let iPabr be a purifi- 
cation of pab • The goal is that some distant decoder 
C will share a state which will approach ip® ^ R for large 
n. To this end Alice and Bob will independently send 
qubits to Charlie. The problem is to find the region of 
pairs of rates Ra and Rb of sending qubits by Alice and 
Bob, respectively, to Charlie which achieve the goal. We 
assume that Charlie shares auxiliary entanglement with 
Alice and Bob, separately. Bounds to this region, without 
the auxiliary entanglement, were given in [a]. In partic- 
ular it was shown that the rate pairs 

Ra = \l{A : R), R B = S{B), 

R A = S(A), R B = \l{B : R), 

are achievable. Note that this implies the rate sum Ra + 
R B = \J{A : B), with J[A : B) := S(A) + S(B) + 
S(AB). On the other hand, the rate region is bounded 
as follows: 

Ra > \l{A : R), 
Rb > \j{B : R), 
Ra + Rb> \j{A : B) - E m (p AB ). 

While we are not able to describe the whole region for 
distributed compression, we provide the optimal sum of 
Ra and Rb- Our expression is not single-letter though. 

Theorem 7 (Bipartite case) Given a bipartite source 
Pab, the minimal sum of the rates of distributed com- 
pression is given by 

Ra + Rb = \j{A : B) - I ind { PAB ). (14) 

The direct and converse part of the theorem is proved in 
the Supplementary Materials. 

Multipartite case. For N parties A±...An, we define 
J{A 1 : A N ) = S(A{) + ... + S(A N ) + S(A 1 . . . A N ). 
We have the following formula for the optimal sum of 
rates: 

N 1 

J2Ri=^J(A 1 :...:A N )-I iDd (p). (15) 

4=1 

The proof of the formula is analogous to the bipartite 
case. It is interesting to rewrite the formula in the exact 
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case, i.e. if there is division A± . . . An = a\a\ . . . a.N(iN 
such that the system a± . . . ajv is product with R. Then, 

N 

»=i (16) 
+ ^[I(A 1 : ... : A N )-I{ax : ... : a N )}, 

where we have divided the sum into two parts: 
S(Ai . . . An) is the rate when all the systems are together 
(this would be the rate of compression, if we were send- 
ing classical information), while the second term is the 
quantum correction. The latter says that in distributed 
case, we have to send all the correlations that are not 
independent of R: the total correlations I(Ai : . . . : An) 
minus the independent ones I(a\ : . . . : ckjv)- 

Conclusions. We have introduced a generalization of 
private bits, which we call mutual independence, and de- 
fined the asymptotic amount of mutual independence as 
^ind(p)- The quantity seems hard to compute, and even 
bounds are in general hard to come by. 

Apart from an upper bound by the squashed entan- 
glement, we attempted at giving another upper bound 
in terms of the relative entropy of entanglement in the 
Supplementary Materials, which remains contingent on 
an unproven Conjecture - in fact, this conjecture itself 
is quite interesting as it claims that the effect of entan- 
glement locking [13| cannot occur if the state is product. 
Furthermore, we expressed our belief that mutual inde- 
pendence is generically zero in another conjecture, about 
certain local algebras of operators derived from the state. 

The most important result is however the relation be- 
tween distributed quantum data compression and mutual 
independence: in fact, ii n d(/°) is precisely by how much 
the optimal rate sum of the separate compressors can go 
below \ J, which is the rate guaranteed by fully quantum 
state merging. Note however that Theorem [7] describes 
the rate region only in a very weak sense: looking at the 
proof, we see of course that for a sequence of isometric 
splittings A n aa, and B n b(3 with asymptotic mu- 
tual independence in a/3, one can achieve the rate pair 

R A = lim —I(a : R n B n ), 

R B = lim — I(b : R n a\a). 

n— >oo 2n 

But what region these points span is completely unclear. 
For instance, it is open whether the extreme "corner" 
points 

R A = ^I(A : R), R B = S(B) - I ind (p A B), and 
Ra - S(A) - I ind { P AB), Rb = \l{B : R), 

are achievable - though this appears rather doubtful, 
from looking at the proof of Theorem \7\ (Note that by 



the state redistribution protocol, we also get information 
on how much entanglement between senders and receiver 
is required.) Analogous results and similar open ques- 
tions are also obtainable in the multipartite case. There 
are many other problems, which we haven't touched in 
this paper. For example, we have not analysed the sce- 
nario where classical communication between parties is 
allowed, e.g. one way or two way. In particular, it is in- 
triguing whether allowing a sublinear amount of classical 
communication could eliminate the discontinuity of the 
quantity which most likely holds in the case with no com- 
munication. One may also examine the scenario, where 
Alice and Bob are allowed to share entanglement not only 
with the receiver, but also between themselves. We also 
do not know the amount of mutual independence in the 
singular cases such as the maximally correlated state. We 
have also not resolved whether our technical assumption 
that the size of the systems a and (3 scale linearly with 
the system size is needed. 
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SUPPLEMENTARY MATERIALS 

CONNECTION WITH PBITS AND 
CHARACTERIZATION OF STATES WITH 
MUTUAL INDEPENDENCE 

Pbits are quantum states paba'B' which exhibit one 
bit of perfect key after Alice and Bob perform local mea- 
surement on parts AB of their systems. This means that 
the results are uncorrelated with R, and moreover, they 
are maximally correlated. Equivalently, one could de- 
fine private states as such states paba> b< , for which after 
tracing out systems A'B' , the systems AB already repre- 
sent perfect key, i.e. measurement is not needed. Clearly 
these can be obtained from the original pbits by apply- 
ing coherent measurement. (See [JEH ^ or a discussion 
of equivalent forms of private states.) 

In any QKD protocol, Alice and Bob end up with pbits. 
Moreover the distillable key (by means of two-way, one- 
way classical communication or even with no communi- 
cation at all) is simply given by the rate of obtaining 
pbits from many copies of a given shared state. 

Let us now suppose that we apply the measurement 
coherently, i.e. apply c-not onto some ancillas a(3. Then 
the system afl is product with R, and has mutual infor- 
mation 1. Note however, that this is often an underesti- 
mate. E.g. the singlet state, which is a valid pbit, has 
2 bits of mutual independence. The characterization of 
states containing mutual independence is in analogy to 
a similar characterization of pbits (the unitary below is 
analogous to the so-called twisting Q|) and is given by 
Proposition 3 of the main paper. Namely: 

Proposition 1 A state paba'B' has mutual indepen- 
dence in systems AB, if and only if there exists an isom- 
etry U : A'B' -»■ CD such that 

(Mab ® U A 'b<)paba>b>{Zab ® Ua'b'Y = i> A BC ® Pd, 

(17) 

with a pure state ip on ABC. 

Proof. It evident that states satisfying the above con- 
ditions have mutual independence. Conversely, let us 
take a state which has mutual independence. We con- 
sider the purification ipABA'B'R of paba'B' and by as- 
sumption know that pabr = Pab ® PR, where pabr — 
Tta'B'^aba'B'R- Then one can clearly find a state of the 
form ipABC <8> <Prd, which is also a purification of pabr 
(where (fRD is purification of pr. and ipABC is purification 
of pab)- Since purifications of a given state are related 
by an isometry, we obtain that 

i'ABC'&VRD = {tABR.®U A 'B')^ABA'B'R{tABR®U A 'B')\ 

(18) 

because both states are purifications of pabr, as we 
wanted. □ 
The reasoning is thus similar to the decoupling tech- 
nique [l(| which was succesfully applied to quantum state 



merging, both in the original [l7L E3] and fully quantum 
setting [6j as well as for new proofs of quantum Shannon 
theorem, see e.g. The same technique was also used 
in [3] in proving relations between two key distillation 
scenarios: one related to distillation of pbits (i.e. states 
belonging to Alice and Bob solely) and the other one re- 
lated to distillation of key as a tripartite state between 
Alice, Bob and Eve. 

As a matter of fact this simple observation is what 
allows us to apply the notion of mutual independence 
to the problem of distributed compression of quantum 
information discussed further on in the paper. 

DISCUSSION OF CONJECTURE 4 AND 
DISCONTINUITY OF MUTUAL 
INDEPENDENCE 

As a first step to proving Conjecture 4 of the main 
paper, we can show that If Iind(pAB) > 0, then there 
exist operator subspaces A^ n ' and of the full local 
operator algebras C{A n ) and C(B n ), respectively, both 
containing the unit 1, and a sequence of e n — > 0, with 
the following property. For any ensemble decomposition 

of Pab = E i PjlV'j n) }(^j n) | and any A € A™ , B G fiW, 
Pi I I A ® B\^ n) ) - Trp®" (A®B)\ < en\\A®B\\. 

(19) 

One then needs to show that this implies that the single- 
letter version (Conjecture 4), also holds. That Equation 
(fl9"ll holds is almost trivial. Namely, consider the CP 
map A which generates productness. Independence of 
Eve requires that the final state is the same regardless of 
initial state \tpj )■ Then for any operator A' (S> B' , the 
ability to generate productness implies 

Tr(A' ® S'A(|vf ) D) * MA' ® 5'A(|^) 

(20) 

We consider the dual map to go to the Heisenberg picture 
of operators A' ® B' , This is still a product map i.e. 
A* (A' ® B') = A®B, since A was a product map. So we 
have 

(^ n) \A®B\^ n) ) « (4 n) |A® J B|V>£" ) ) (21) 

Observe that the conjecture holds for the maximally 
correlated states of the example in the main paper, where 
A®B = a z ®d z . Since, to get mutual independence from 
maximally correlated states Alice and Bob dephase their 
systems locally in bases of a z and apply privacy ampli- 
fication to the resulting classical data, it suggests a gen- 
eral method for distilling mutual independence - namely, 
both parties measure or dephase a set of commuting A®~&. 
and 1 ® B, and apply local privacy amplification. 

I.e. suppose that Alice and Bob, by dephasing their 
state in local bases obtain a probability distribution, 
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about which Eve has only local information i.e. Eve's in- 
formation is a sole result of action of two local channels, 
one from Alice, a second from Bob. Then it is clear that 
Alice and Bob simply need to perform local privacy am- 
plification on their measurement outcomes. Now, privacy 
amplification forces Alice to loose nI(A : E) systems, 
which will reduce her mutual information with Bob by 
the same amount. Likewise, Bob needs to loose nI(B : 
E) systems, reducing the mutual information between 
him and Alice by potentially an additional nI(B : E) 
bits (although potentially no reduction need occur, e.g. 
in the case of maximally correlated states) . This proto- 
col will produce mutual independence at a rate of at least 
I (A : B) - I (A : E) - I(B : E), provided this quantity is 
positive. Here A, B are the post measurement outcomes. 

To obtain an example, one could consider first the clas- 
sical state of the form 



UPPER BOUND FOR MUTUAL 
INDEPENDENCE 

In [fj, Theorem X.2] one can find implicitly a proof of 
the bound I m d (pab) < E sq (pAB), the squashed entan- 
glement Q. The argument, in a nutshell, is this: isomet- 
rically splitting A n — ► aa and B n — > 6/3, and for any like- 
wise splitting R n — ► EF, we assume approximate mutual 
independence i.e. p a pR™ ~ p af3 <8> Pr™, which by Fannes' 



inequality [2l| (in the form given in [22 ]) translates into 



o(n) > I{a/3 : R n ) > I (a/3 : E), 



(23) 



Pabe = J2 Pij\ i 3)( i j\®(( 1 -P) t E 1 /d + p\i){i\) g> {(l-p)t E Jd + p\j){j 

(22) 



the second inequality by monotonicity of the quantum 
mutual information. (Note that in the inequality of [22 1 
only a dimensional factor of log|i?' l | = 0(n) enters.) 
Hence, using a straightforward identity, 

I{a : f3) = I (a : f3\E) 

+ I (a : E) + I{(3 : E) - I{a(3 : E) 
I(a : /3\E) + I(ot(3 : E) (24) 



I(A n : B n \E) + o(n), 



(25) 



using monotonicity three more times. By the definition 
of squashed entanglement, and its additivity Q, we find 



where Pij is an arbitrary probability distribution, and 
the first system is on AB, and the second and third sys- 
tems are with Eve. Here, obviously, Eve has only local 
information in the above sense. Now, one can consider 
the purification, and hand it to Alice and Bob. It seems, 
that if we distribute it into Alice and Bob systems in a 
nontrivial way, the total state should not show mutual 
independence on the single copy level. 

However, one may find examples where this protocol 
may not work. E.g. we start with the example of equa- 
tion [22] (purified in whichever way, with the purification 
handed to Alice and Bob). Then, as the operators A 
and B we can take operators of the form Xa ® 1a' and 
Xb <£> 1b' where X's are diagonal in the basis which 
is complementary to the standard basis. The results 
will then be completely uncorrelated. However, one can 
choose the operators to be diagonal in the standard ba- 
sis, so that the method works. It is possible that we 
can always find such operators A and B, such that the 
measurement in their bases, and subsequent local privacy 
amplification is a good strategy (provided the mutual in- 
formation between Alice and Bob is large enough). 

Finally, we wish to highlight that Conjecture 4 refers to 
the impossibility of obtaining a positive rate for mutual 
independence. There are however situations where one 
can obtain a single bit of mutual independence but at 
zero rate. I.e. given an arbitrarily large number of copies 
of an initial system, one can get a single bit which has 
non-zero correlation and is private [20l |. 



1 1 

n2 



I(a : /3) - o(l) < E sq (p AB ), 



(26) 



and we only need to take the limit n — > oo. 



□ 



Remark. The above proof actually requires much less 
than R n to be (approximately) product with a(3: indeed, 
looking at eq. {24]), we see that the correction term could 
be replaced by any of I{a : E) or 1(0 : E), so that it 
is sufficient that either a or (3 is product with R n . This 
suggests that the bound by squashed entanglement is not 
particularly tight. 

Proof. Since mutual information is additive, it is 
enough to prove that E r is an upper bound. Then by 
applying the result to many identical copies it follows 
that E^° is a bound, too. Consider the closest separable 
state a to p in relative entropy distance, with respect to 
the cut A A' : BB' . Since our state has mutual indepen- 
dence in system AB, according to Proposition Q] there 
exists an isometry U : A'B' — > CD such that 

(±AB ® U A 'B')PABA'B'{tAB ® U A' B') ] = ^ ABC ® PD- 

(27) 



Thus we have 



E r (pABA'B' 



S{pABA>B< 
S{lpABC ® 



WaBA'B') 

Pd\W'abcd) 



(28) 



> S(^abc\W' A bc) 



where a' = (Iab ® Ua'B')v{~$-AB ® Ua'B'Y ■ Note that 
while oaa'BB' is separable, a' has no obvious separability 
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properties. However, since uaa'BB' = Y^iPi^AA 1 
we find that u' ABC = Y^iPi^ABC' where each 



0) 
] Wb> 



ABC 



Tr D (t AB ® C/a'B' ) ® Vbb>) &-ab ® Ua'B-V 

(29) 



has the property that the marginal a AB is a product 
state. 

Let us now imagine for a while that the system C is 
distant from A. We then take k copies of the state ip, and 
consider an operation that merges system C to system A, 
in such a way that the new state p' A k C k B k satisfies 



\PA k C k B k ~~ V 1 



ACB || i 



< e. 



(30) 



It is known, that one can perform such an operation [6| 
by sending \l(C : B) + S qubits per copy, with e and S 
tending to zero for large k. 

Before proceeding, we shall quickly outline the further 
reasoning. As a result of merging (i.e. enlarging the cut 
A : B to AC : B), we arrive at a pure state with entan- 
glement S(B) per copy. We shall apply the same oper- 
ation to a', and appealing to Conjecture 5for the state 
, will argue that it can increase its entanglement by 
no more than the number of sent qubits. Thus we are 
left with relative entropy between a pure state of given 
entanglement and some state which is not separable any- 
more, but entanglement of which is bounded from above 
by \l{C : B) per copy. Therefore, the relative entropy 
must be bounded from below, and we shall show that it 
is bounded by the difference between the entanglements 
of the two states, which is precisely \l{A : B). Com- 
ing back to the proof, let us examine the action of the 
merging protocol on the state (cr ACB )' sk . The latter is a 



(h) 

ACB 



ACB 



as in H29H. which 



mixture of states a 
are product after tracing out the systems C. Therefore, 
by Conjecture 5 after merging, for each such state the 
logarithmic negativity Em cannot become greater than 
k{I(C : B)+8) or, equivalently, ||(-) r ||i < 2 fc ( / ( C:S >+ 5 > 
Due to convexity of the trace norm, we obtain that the 
same is true for the total state, hence, by monotonicity 
of logarithm, En < k(I(C : B) + S) for the total state. 

Continuing from eq. (j28j) . and denoting A = AC, we 
obtain 



kE r (ft 



ABA'B 



) > S(p AkBk \\cr'L k ), 



(31) 



where p' AkBk satisfies eq. l|30jl . while, as argued above, 
for the state &" AkBk resulting from the merging applied 

to ((T ACB )^ k , we nave 



E N [a") < k(l(C :B)+6). 



(32) 



We now apply entanglement concentration [23j to the 
state p' AkBk , which turns it to a state close to the 
maximally entangled state living on dimension d x d 

with d > 2 k ( st - B ^ s ) . The same operation is applied 



to state a't u . This operation we follow by U ® U* 
twirling [24 . l25l |. As a result, we obtain two isotropic 
states pi so (F,d), ai BO (F',d) where we use the notation 

Piso (^, d) = F$ d + (i - (33) 

with the maximally entangled state $ d onarfx d-system. 
The dimension d satisfies d > 2 k ( s ( B ^~ s ) where we can 
take 5' — ► for large k. Moreover F — ► 1 for large k, and 
En {&\so) < k(I(A' : B) + S), again with <5 ^ for large 
k. 

Since for F' > \, we have E N (<Ji so (F', d)) = log(F'd), 
which by eq. (|32"1) gives 



logF' < k (J-I(C ■ B) - S(B) + S + S' 



Since the state i^acb was pure, we obtain 
logF' < -k (\l{A :B)-S-5' 



(34) 



(35) 



The monotonicity of relative entropy and eq. (|3Tjl now 
give 



kE r (pAA'BB') > S(p iso (F,d)\\a iso (F',d)) 

= S({F,1-F}\\{F',1-F'}). 



(36) 



This expression is continuous in F for F' < 1, hence 
we can set F = 1, incurring another small deviation, 
S({F, l—F}\\{F',l — F'}) > - log F' — 5" , and we obtain 



E r (p 



AA'BB 



)>-I(A:B)-S-S'-S". 



(37) 



Sending S, 5' and 5" to zero, we obtain the result. □ 



PROOF OF DIRECT PART AND CONVERSE OF 
THEOREM 5 

Remark. The converse part for the case without shared 
entanglement was provided implicitly in jij]. Here we 
show that it extends to our scenario of auxiliary ebits. 

Proof (Direct part). Let us first note that to achieve 
the goal it is enough that at the end Charlie's system and 
the system R are in a pure state. Indeed, all purifications 
of R are equivalent up to an isometry on Charlie side. 
Applying such an isometry, Charlie can reconstruct the 
required state. 

To proceed, let us first assume that the state p® B 
has exact mutual independence. That is, there are lo- 
cal isometries which allow us to write the state as p aa bp 
with a(3 being private, i.e. /(a/3 : R m ) = 0. 

Let us now argue that it is enough to send a and b to 
Charlie. Indeed, suppose that Charlie has the ab system. 
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Then, due to Proposition [TJ Charlie can apply an isome- 
try U : ab — > C7 such that a/3j is in a pure state. Now 
he can remove system 7 because it is not correlated with 
R, and the state of the system R m C is now pure. Thus, 
given our initial remark, the transmission of information 
to Charlie was achieved. 

Now, let us argue that we can achieve the rate sum in 
eq. (12) of the main paper. 

R A + R B = ^J(A : B) - L mA {p AB )- 

To this end, Alice and Bob will send a and b by way of 
the state redistribution protocol [26]. Suppose that Alice 
sends a, using a as side-information to be retained at her 
side; then Bob can send b using j3 as side-information 
to be retained by him, and a as side-information at the 
receiver (the other case gives the same sum of rates). 
Thus, we obtain the rate pair 

1 



mR A = -I(a : R m b(3) 

= l -(S{a) + S{A m )-S{a)), 
mR B = ^I{b : R m a\a) 



(38) 



= - (S(ab) + S(R m A m ) - 509) - S(a)) , (39) 



so that 



m{R A +R B ) = -(S(A m )+S(B m )+S(ab)-S(a)-S(p)). 

(40) 

Now, since the system a/3 is product with R m , we have 
I(a(3 : R m ) = 0, i.e. S(A m B m ) + S{aj3) = S(ab). In- 
serting this into eq. I|40jl and dividing by m, we obtain 
eq. (12) of the main paper. 

Suppose now that mutual independence is not exact, 
but achievable asymptotically. This means that given 
any e, there some number of copies m such that Alice and 
Bob can transform the state V'ab.b Y1& l° ca l isometries 



into a state ip 



(m) 
aab/3R 



whose reductions satisfy 



I (m) 
\Pal3R 



(to) 
Pa/3 



'PR 



< e. 



(41) 



If ab could be sent to Charlie exactly, then he would 
be able to reconstruct the purification of R with fidelity 
> const. y/e. To do this would be too costly in terms 
of communication, however they can be transferred with 
arbitrary high fidelity, by use of state redistribution, ap- 
plied to k copies of p^ig, where k is chosen to be large, 
but say k < l/y/e, so that in light of eq. (f4l"j) . 



I (to)®/s 
\Paf3R. 



Pj 



Pr 



®km I 



< 



(42) 



Then, having ab with high fidelity, Charlie can recover 
the source with arbitrarily high fidelity. Letting m — > 00 



and e — > would complete the direct part. All that is 
left is to argue why a comparably small k can suffice - 
note that theorems such as the main result in are 
typically stated as asymptotic results for k — > 00 as the 
source state remains fixed. 

We use the insight of (13] to see that only two one- 
shot versions of the coherent state merging protocol 0] 
are needed. The fidelity of those, in turn, only depends 
on the fidelity, dimensions and maximum eigenvalue of 
certain typical subspaces. If we use the entropy-typical 
subspaces of [13], i.e. for a = J2 x ex ^x\x)(x\ it is 



S = span < \x\ . . . Xk) 



^-logA^-fc5(cr) 
i=i 



< k5 



and the projector II satisfies 



(43) 



> 1 - 2(1 ° g I* l)2 =:1-V, (44) 



k5 2 

(1 — ri)2 ks ^~~ kS < Trll < 2 fes ' <T ' +fc(5 
IIcT®' c n < 2 — fc 'S( cr ) _fc * 

Am) 



(45) 
(46) 



We now apply this to p ab ^g and with S = mSo- So, mind- 
ful of eq. (5) of the main paper, we find rj — — fjpr^ - 
above, while the exponential rates - normalized with 
n = km - are bounded within So around the entropy 
rate ^S(a). Choosing 60 arbitrarily small, as a function 
of k, say So = fc~ 1//3 , concludes the direct part. 

(Converse part). We shall actually study the whole 
rate region. This is very similar to only now we have 
to deal with the free entanglement; on the other hand, 
the converse also becomes easier since we are not after a 
single-letter formulation. 

We consider the most general protocol: for n copies of 
the source, initially V'ab.r ls distributed between Alice, 
Bob and the reference. In addition, Alice and Charlie 
share entanglement <j>A c a , Bob and Charlie share entan- 
glement 9B c b , so that the state at the beginning is 



^ A™A ,B™B ,R n ,C a C b 



ABR 



>4>A C a ®8B C b - (47) 



Alice's (Bob's) encoding can be represented in the Stine- 
spring form as an isometry A n Ao — > aoa (B n Bo — > bo/3); 
Alice (Bob) then sends ao (bo) to Charlie, keeping a ((3). 

Now the existence of a decoding operation of Charlie's, 
i.e. a isometry aoboC a Cb — > A n B n j, such that the result- 
ing state pa™ b» r™ ~ ^abr^ implies - indeed is equivalent 
to - p^g Rn ~ P^p^Pr 71 - I- e - there is approximate mutual 
independence in p®b- The entanglement with Charlie in 
the procedure is of no consequence here. Indeed, letting 
a := aoC a and b := boCb, we get the following lower 
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bounds on the rates: 

nR A > S(a ) > ij(a : R n B n \C a ) = ^I(a : R n B n ), 

nR B > S{b ) > -I{b : R n a\aC b ) = -I{b : R n a\a), 

as I(C a : R n B n ) = I{C b : R n A n ) = 0. So, as before in 
the direct part, we obtain the rate sum 



i(Ra + Rb) > \[S(A n ) + S(B n ) 



+S{ab) - S(a) - S(P)] 
> l -J{A n :B n )-\l{a:P)-o{n), 



(48) 



using the fact that R n and a0 are almost product, i.e., 
invoking Fannes' inequality 21 1 in the formulation of [12], 
I(R n : a/3) = o(n). Taking n — > oo concludes the proof. 

□ 

Our theorem implies that one can beat the rate \ J (A : 
B) - D (p AB ) of i where D is the distillable entan- 
glement by means of local operations only, as had been 
suggested in 0|. Indeed, for pdits 7, 



-find (7) > 2 lo & d ' 



(49) 



while there are pdits such that even (> D ) is arbi- 
trarily close to zero 



CLASSICAL ANALOGUE 

In the paper, we have considered the case of the quan- 
tum mutual independence, as well as its relation with 
distributed compression. We can also consider the anal- 
ogous classical problem. Here, we will find that for clas- 
sical distributed compression, the solution is singular, as 
we suspect it is in the quantum case. However, this does 
not imply that mutual independence is singular, because 
as we shall see, in the classical case, distributed compres- 
sion and mutual independence are not as closely linked 
as they are in the quantum case. 

For classical mutual independence, instead of a tripar- 
tite pure state, one considers a tripartite classical prob- 
ability distribution Pxyz of random variables XYZ, 
with Z being the reference and XY being held by Al- 
ice and Bob. The probability that the source produces 
XYZ = xyz is denoted by Pxyz (xyz). The defini- 
tions of quantum mutual independence and distributed 
compression then follow exactly as in the quantum case. 
Note that the objective in the latter is to allow Charlie 
to recreate a sample from the joint distribution Pxyz 
(while Z remains hidden and with the reference at all 
times), not necessarily to reproduce the sample given 
initially to Alice and Bob. For distributed compres- 
sion, the situation is then analogous to blind compres- 
sion with mixed states. I.e. conditioned on each Z = z, 



Alice and Bob are given a sample from the distribution 
Pxy\z=z- The extreme case that Z = XY is a normal 
data compression problem, since PxY\z=xy — ^XY,xy', it 
was solved by Slepian and Wolf [29( who showed that 
the rate sum Ra + Rb can achieve the Shannon entropy 
H(XY) = - E. xy PxY(xy) log PxY(xy). 

Of course, if Z does not represent full information of 
XY, the optimal rate sum could be smaller. We find 
below that for distributed compression, the optimal rate 
sum is singular in the sense that for it to be smaller than 
H(XY), the single-copy distribution Pxyz must be in a 
certain set of measure zero. In particular, the minimum 
rate sum is discontinuous. 

To show this, we now ask what is the best compression 
rate which can be achieved in the case of signal states 
which are mixed, even when Alice and Bob are together. 
Consider the distribution given to the senders for each 
Z; then there exists a natural decomposition into a part 
which can depend on Z, and one which does not (i.e. a 
part which is redundant): there exists a 1-1 identification 
r : X x y — > \J' t Ji X Kt such that for r(xy) = jk G 
Jt x fCe, 

PxY\z= z (xy) = q(e\z)P Jlz = z , L=e (j)PK\L=e(k), (50) 

with a distribution q{£\z) for every z. Then the best 
achievable compression rate is given by H(LJ). I.e., the 
best one can do is to remove the redundant part PK 
that manifest already on the single-copy level - collective 
actions cannot do better than this. The proof of this 
statement follows from a straightforward application of 
the analogous quantum result of Koashi and Imoto 
and we will therefore not give it here. 

Now, when Alice and Bob are seperated and are at- 
tempting to perform the compression, they may not even 
be able to achieve the rate Ra + Rb = H(LJ), because 
they may not be able to remove the redundant part when 
they are in distant labs. However, it still does provide a 
lower bound on their rate, showing that only if there is 
single-copy redundancy in Pxy z , they can ever beat the 
rate sum H(XY). This leaves open the interesting prob- 
lem of what the achievable rate is - we conjecture that 
it is possible to go below H(XY) if and only if a decom- 
position into relevant and redundant parts as in eq. |50|) 
is achievable on the single-copy level by local actions of 
Alice and Bob. 

Note however, that in the classical case, the relevant 
quantity is how much of the redundancy in the distri- 
bution - that which is independent of Z - can be re- 
moved. The redundant part is independent of Z but 
the converse need not be true - a random variable can 
be independent of Z but not be redundant. An ex- 
ample of this is the following distribution: with some 
probability p, Alice and Bob have correlated bits (c), 
and with probabilty 1 — p, they have anti-correlated 
bits (a). I.e. Pxyz(00c) = P X yz(Uc) = p/2 and 
PxYz{0la) = PxYz(Wa) = (l-p)/2. Here, both X and 
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Y are independent of Z but we conjecture that neither is 
redundant (in single copy it is obvious, but for collective 
actions it is not proven yet). On the other hand, an op- 
eration on both XY and remove a redundant bit, under 
the map 00 -> 0, 11 -> 0, 01 -> 1 and 10 -► 1. 

By contrast, mutual independence is defined as in the 
quantum case, only without the factor of 1/2: we con- 
sider local randomized functions F and G such that 
F(X n )G(Y n ) are jointly asymptotically independent of 
Z n , and maximize the limiting rate 

liminf -l(F(X n ) : G(Y n )) (51) 

n^oo n 

over all protocols, to obtain Ii„d{X : Y\Z). Observe 
that there are distributions with positive mutual inde- 
pendence, but no gain in distributed compression. For 
example, let X = Y and the conditional distribution 
of X\Z be such that it doesn't have any redundancy in 
the sense of eq. (|50| and jjjfj. Then - via local hashing 
by the same function -, l m d{X : Y\Z) = H(X\Z), but 
Ra + Rb> H{X). 

Let us finally remark, that one can unify quantum and 
classical approches as in [HH by considering mixed tri- 
partite state pabe, and extend the definition in most 
natural way. 
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